• Comparative validation of multi-instance instrument segmentation in endoscopy: Results of the ROBUST-MIS 2019 challenge 

      Ross, Tobias; Reinke, Annika; M. Full, Peter; Wagner, Martin; Kenngott, Hannes; Apitz, Martin; Hempe, Hellena; Mindroc Filimon, Diana; Scholz, Patrick; Tran, Thuy Nuong; Bruno, Pierangela; Arbeláez, Pablo; Bian, Gui-Bin; Bodenstedt, Sebastian; Lindström Bolmgren, Jon; Bravo-Sánchez, Laura; Chen, Hua-Bin; González, Cristina; Guo, Dong; Halvorsen, Pål; Heng, Pheng-Ann; Hosgor, Enes; Hou, Zeng-Guang; Isensee, Fabian; Jha, Debesh; Jiang, Tingting; Jin, Yueming; Kirtac, Kadir; Kletz, Sabrina; Leger, Stefan; Li, Zhixuan; H. Maier-Hein, Klaus; Ni, Zhen-Liang; Riegler, Michael; Schoeffmann, Klaus; Shi, Ruohua; Speidel, Stefanie; Stenzel, Michael; Twick, Isabell; Wang, Gutai; Wang, Jiacheng; Wang, Liansheng; Wang, Lu; Zhang, Yujie; Zhou, Yan-Jie; Zhu, Lei; Wiesenfarth, Manuel; Kopp-Schneider, Annette; P. Müller-Stich, Beat; Maier-Hein, Lena (Journal article; Tidsskriftartikkel; Peer reviewed, 2020-11-28)
      Intraoperative tracking of laparoscopic instruments is often a prerequisite for computer and roboticassisted interventions. While numerous methods for detecting, segmenting and tracking of medical instruments based on endoscopic video images have been proposed in the literature, key limitations remain to be addressed: Firstly, robustness, that is, the reliable performance of state-of-the-art methods ...
    • A comprehensive analysis of classification methods in gastrointestinal endoscopy imaging 

      Jha, Debesh; Ali, Sharib; Hicks, Steven; Thambawita, Vajira L B; Borgli, Hanna; Smedsrud, Pia H.; de Lange, Thomas; Pogorelov, Konstantin; Wang, Xiaowei; Harzig, Philipp; Tran, Minh-Triet; Meng, Wenhua; Hoang, Trung-Hieu; Dias, Danielle; Ko, Tobey H.; Agrawal, Taruna; Ostroukhova, Olga; Khan, Zeshan; Tahir, Muhammed Atif; Liu, Yang; Chang, Yuan; Kirkerød, Mathias; Johansen, Dag; Lux, Mathias; Johansen, Håvard D.; Riegler, Michael; Halvorsen, Pål (Journal article; Tidsskriftartikkel; Peer reviewed, 2021-02-19)
      Gastrointestinal (GI) endoscopy has been an active field of research motivated by the large number of highly lethal GI cancers. Early GI cancer precursors are often missed during the endoscopic surveillance. The high missed rate of such abnormalities during endoscopy is thus a critical bottleneck. Lack of attentiveness due to tiring procedures, and requirement of training are few contributing factors. ...
    • A Comprehensive Study on Colorectal Polyp Segmentation with ResUNet++, Conditional Random Field and Test-Time Augmentation 

      Jha, Debesh; Smedsrud, Pia; Johansen, Dag; de Lange, Thomas; Johansen, Håvard D.; Halvorsen, Pål; Riegler, Michael Alexander (Journal article; Tidsskriftartikkel; Peer reviewed, 2021-01-05)
      Colonoscopy is considered the gold standard for detection of colorectal cancer and its precursors. Existing examination methods are, however, hampered by high overall miss-rate, and many abnormalities are left undetected. Computer-Aided Diagnosis systems based on advanced machine learning algorithms are touted as a game-changer that can identify regions in the colon overlooked by the physicians ...
    • DoubleU-Net: A Deep Convolutional Neural Network for Medical Image Segmentation 

      Jha, Debesh; Riegler, Michael Alexander; Johansen, Dag; Halvorsen, Pål; Johansen, Håvard D. (Journal article; Tidsskriftartikkel; Peer reviewed, 2020-09-01)
      Semantic image segmentation is the process of labeling each pixel of an image with its corresponding class. An encoder-decoder based approach, like U-Net and its variants, is a popular strategy for solving medical image segmentation tasks. To improve the performance of U-Net on various segmentation tasks, we propose a novel architecture called DoubleU-Net, which is a combination of two U-Net ...
    • FANet: A Feedback Attention Network for Improved Biomedical Image Segmentation 

      Jha, Debesh; Riegler, Michael; Johansen, Håvard D.; Johansen, Dag; Rittscher, Jens; Halvorsen, Pål; Ali, Sharib (Journal article; Tidsskriftartikkel; Peer reviewed, 2022-03-25)
      The increase of available large clinical and experimental datasets has contributed to a substantial amount of important contributions in the area of biomedical image analysis. Image segmentation, which is crucial for any quantitative analysis, has especially attracted attention. Recent hardware advancement has led to the success of deep learning approaches. However, although deep learning models are ...
    • HTAD: A Home-Tasks Activities Dataset with Wrist-Accelerometer and Audio Features 

      Garcia-Ceja, Enrique; Thambawita, Vajira L B; Hicks, Steven; Jha, Debesh; Jakobsen, Petter; Hammer, Hugo Lewi; Halvorsen, Pål; Riegler, Michael (Journal article; Tidsskriftartikkel; Peer reviewed, 2021-01-21)
      In this paper, we present HTAD: A Home Tasks Activities Dataset. The dataset contains wrist-accelerometer and audio data from people performing at-home tasks such as sweeping, brushing teeth, washing hands, or watching TV. These activities represent a subset of activities that are needed to be able to live independently. Being able to detect activities with wearable devices in real-time is important ...
    • HyperKvasir, a comprehensive multi-class image and video dataset for gastrointestinal endoscopy 

      Borgli, Hanna; Thambawita, Vajira; Smedsrud, Pia H; Hicks, Steven; Jha, Debesh; Eskeland, Sigrun Losada; Randel, Kristin Ranheim; Pogorelov, Konstantin; Lux, Mathias; Dang Nguyen, Duc Tien; Johansen, Dag; Griwodz, Carsten; Stensland, Håkon Kvale; Garcia-Ceja, Enrique; Schmidt, Peter T; Hammer, Hugo Lewi; Riegler, Michael; Halvorsen, Pål; de Lange, Thomas (Journal article; Tidsskriftartikkel; Peer reviewed, 2020-08-28)
      Artificial intelligence is currently a hot topic in medicine. However, medical data is often sparse and hard to obtain due to legal restrictions and lack of medical personnel for the cumbersome and tedious process to manually label training data. These constraints make it difficult to develop systems for automatic analysis, like detecting disease or other lesions. In this respect, this article ...
    • Kvasir-Capsule, a video capsule endoscopy dataset 

      Smedsrud, Pia H; Thambawita, Vajira L B; Hicks, Steven; Gjestang, Henrik; Olsen Nedrejord, Oda; Næss, Espen; Borgli, Hanna; Jha, Debesh; Berstad, Tor Jan; Eskeland, Sigrun Losada; Lux, Mathias; Espeland, Håvard; Petlund, Andreas; Dang Nguyen, Duc Tien; Garcia, Enrique; Johansen, Dag; Schmidt, Peter Thelin; Toth, Ervin; Hammer, Hugo Lewi; de Lange, Thomas; Riegler, Michael Alexander; Halvorsen, Pål (Journal article; Tidsskriftartikkel; Peer reviewed, 2021-05-27)
      Artificial intelligence (AI) is predicted to have profound effects on the future of video capsule endoscopy (VCE) technology. The potential lies in improving anomaly detection while reducing manual labour. Existing work demonstrates the promising benefits of AI-based computer-assisted diagnosis systems for VCE. They also show great potential for improvements to achieve even better results. Also, ...
    • Kvasir-SEG: A Segmented Polyp Dataset 

      Jha, Debesh; Pia H, Smedsrud; Riegler, Michael; Halvorsen, Pål; de Lange, Thomas; Johansen, Dag; Johansen, Håvard D. (Journal article; Tidsskriftartikkel; Peer reviewed, 2020-01-24)
      Pixel-wise image segmentation is a highly demanding task in medical-image analysis. In practice, it is difficult to find annotated medical images with corresponding segmentation masks. In this paper, we present Kvasir-SEG: an open-access dataset of gastrointestinal polyp images and corresponding segmentation masks, manually annotated by a medical doctor and then verified by an experienced ...
    • LightLayers: Parameter Efficient Dense and Convolutional Layers for Image Classification 

      Jha, Debesh; Yazidi, Anis; Riegler, Michael Alexander; Johansen, Dag; Johansen, Håvard D.; Halvorsen, Pål (Chapter; Bokkapittel, 2021-02-21)
      Deep Neural Networks (DNNs) have become the de-facto standard in computer vision, as well as in many other pattern recognition tasks. A key drawback of DNNs is that the training phase can be very computationally expensive. Organizations or individuals that cannot afford purchasing state-of-the-art hardware or tapping into cloud hosted infrastructures may face a long waiting time before the training ...
    • Machine Learning-based Classification, Detection, and Segmentation of Medical Images 

      Jha, Debesh (Doctoral thesis; Doktorgradsavhandling, 2022-01-21)
      Gastrointestinal tract (GI) cancers are among the most common types of cancers worldwide. In particular, colorectal cancer (CRC) is the most lethal in terms of number of incidences and mortality (third most common cause of cancer and the second common cause of cancer-related deaths). Colonoscopy is the gold standard for screening patients for CRC. During the colonoscopy, gastroenterologists examine ...
    • Meta-learning with implicit gradients in a few-shot setting for medical image segmentation 

      Khadka, Rabindra; Jha, Debesh; Riegler, Michael A.; Hicks, Steven; Thambawita, Vajira; Ali, Sharib; Halvorsen, Pål (Journal article; Tidsskriftartikkel; Peer reviewed, 2022-01-12)
      Widely used traditional supervised deep learning methods require a large number of training samples but often fail to generalize on unseen datasets. Therefore, a more general application of any trained model is quite limited for medical imaging for clinical practice. Using separately trained models for each unique lesion category or a unique patient population will require sufficiently large curated ...
    • MSRF-Net: A Multi-Scale Residual Fusion Network for Biomedical Image Segmentation 

      Srivastava, Abhishek; Jha, Debesh; Chanda, Sukalpa; Pal, Umapada; Johansen, Håvard D.; Johansen, Dag; Riegler, Michael; Ali, Sharib; Halvorsen, Pål (Journal article; Tidsskriftartikkel; Peer reviewed, 2021-12-23)
      Methods based on convolutional neural networks have improved the performance of biomedical image segmentation. However, most of these methods cannot efficiently segment objects of variable sizes and train on small and biased datasets, which are common for biomedical use cases. While methods exist that incorporate multi-scale fusion approaches to address the challenges arising with variable ...
    • A multi-centre polyp detection and segmentation dataset for generalisability assessment 

      Ali, Sharib; Jha, Debesh; Ghatwary, Noha; Realdon, Stefano; Cannizzaro, Renato; Salem, Osama E.; Lamarque, Dominique; Daul, Christian; Riegler, Michael Alexander; Ånonsen, Kim Vidar; Petlund, Andreas; Halvorsen, Pål; Rittscher, Jens; de Lange, Thomas; East, James E (Journal article; Tidsskriftartikkel; Peer reviewed, 2023-02-06)
      Polyps in the colon are widely known cancer precursors identifed by colonoscopy. Whilst most polyps are benign, the polyp’s number, size and surface structure are linked to the risk of colon cancer. Several methods have been developed to automate polyp detection and segmentation. However, the main issue is that they are not tested rigorously on a large multicentre purpose-built dataset, one reason ...
    • Real-Time Polyp Detection, Localization and Segmentation in Colonoscopy Using Deep Learning 

      Jha, Debesh; Ali, Sharib; Tomar, Nikhil Kumar; Johansen, Håvard D.; Johansen, Dag; Rittscher, Jens; Riegler, Michael A.; Halvorsen, Pal (Journal article; Tidsskriftartikkel; Peer reviewed, 2021-03-04)
      Computer-aided detection, localization, and segmentation methods can help improve colonoscopy procedures. Even though many methods have been built to tackle automatic detection and segmentation of polyps, benchmarking of state-of-the-art methods still remains an open problem. This is due to the increasing number of researched computer vision methods that can be applied to polyp datasets. Benchmarking ...
    • Real-Time Polyp Detection, Localization and Segmentation in Colonoscopy Using Deep Learning 

      Jha, Debesh; Ali, Sharib; Tomar, Nikhil Kumar; Johansen, Håvard D.; Johansen, Dag; Rittscher, Jens; Riegler, Michael; Halvorsen, Pål (Journal article; Tidsskriftartikkel; Peer reviewed, 2021-03-04)
      Computer-aided detection, localization, and segmentation methods can help improve colonoscopy procedures. Even though many methods have been built to tackle automatic detection and segmentation of polyps, benchmarking of state-of-the-art methods still remains an open problem. This is due to the increasing number of researched computer vision methods that can be applied to polyp datasets. ...
    • Video Analytics in Elite Soccer: A Distributed Computing Perspective 

      Jha, Debesh; Rauniyar, Ashish; Johansen, Håvard D.; Johansen, Dag; Riegler, Michael Alexander; Halvorsen, Pål; Bagci, Ulas (Journal article; Tidsskriftartikkel; Peer reviewed, 2022-07-22)
      Ubiquitous sensors and Internet of Things (IoT)technologies have revolutionized the sports industry, providing new methodologies for planning, effective coordination of training, and match analysis post-game. New methods, including machine learning, image, and video processing, have been developed for performance evaluation, allowing the analyst to track the performance of a player in real-time. ...